Effects of structure and meaning on cortical tracking of linguistic units in naturalistic speech

Recent research has established that cortical activity “tracks” the presentation rate of syntactic phrases in continuous speech, even though phrases are abstract units that do not have direct correlates in the acoustic signal. We investigated whether cortical tracking of phrase structures is modulated by the extent to which these structures compositionally determine meaning. To this end, we recorded electroencephalography (EEG) of 38 native speakers who listened to naturally spoken Dutch stimuli in different conditions, which parametrically modulated the degree to which syntactic structure and lexical semantics determine sentence meaning. Tracking was quantified through mutual information between the EEG data and either the speech envelopes or abstract annotations of syntax, all of which were filtered in the frequency band corresponding to the presentation rate of phrases (1.1–2.1 Hz). Overall, these mutual information analyses showed stronger tracking of phrases in regular sentences than in stimuli whose lexical-syntactic content is reduced, but no consistent differences in tracking between sentences and stimuli that contain a combination of syntactic structure and lexical content. While there were no effects of compositional meaning on the degree of phrase-structure tracking, analyses of event-related potentials elicited by sentence-final words did reveal meaning-induced differences between conditions. Our findings suggest that cortical tracking of structure in sentences indexes the internal generation of this structure, a process that is modulated by the properties of its input, but not by the compositional interpretation of its output

Bottom-up versus top-down: Effective connectivity reflects individual differences in grapheme-color synesthesia

In grapheme-color synesthesia, letters elicit a color. Neural theories propose that synesthesia is due to changes in connectivity between sensory areas. However, no studies on functional connectivity in synesthesia have been published to date. Here, we applied psycho-physiological interactions (PPI) and dynamic causal modeling (DCM) in fMRI to assess connectivity patterns in synesthesia. We tested whether synesthesia is mediated by bottom-up, feedforward connections from grapheme areas directly to perceptual color area V4, or by top-down feedback connections from the parietal cortex to V4. We took individual differences between synesthetes into account: 'projector'synesthetes experience their synesthetic color in a spatial location, while 'associators'only have a strong association of the color with the grapheme. We included 19 grapheme-color synesthetes (14 projectors, 5 associators) and located group effects of synesthesia in left superior parietal lobule (SPL) and right color area V4. With PPI, taking SPL as a seed region, we found an increase in functional coupling with visual areas (also V4), for the synesthesia condition. With PPI, however, we can not determine the direction of this functional coupling. Based on the GLM results, we specified 2 DCMs to test whether a bottom-up or a top-down model would provide a better explanation for synesthetic experiences. Bayesian Model Selection showed that overall, neither model was much more likely than the other (exceedance probability of 0.589). However, when the models were divided according to projector or associator group, BMS showed that the bottom-up, feedforward model had an exceedance probability of 0.98 for the projectors: it was strongly preferred for this group. The top-down, feedback model was preferred for the associator group (exceedance probability = 0.96). To our knowledge, we are the first to report empirical evidence of changes in functional and effective connectivity in synesthesia. Whether bottom-up or top-down mechanisms underlie synesthetic experiences has been a long-time debate: that different connectivity patterns can explain differential experiences of synesthesia may greatly improve our insight in the neural mechanisms of the phenomenon

Structure-(in)dependent interpretation of phrases in humans and LSTMs

In this study, we compared the performance of a long short-term memory (LSTM) neural network to the behavior of human participants on a language task that requires hierarchically structured knowledge. We show that humans interpret ambiguous noun phrases, such as second blue ball, in line with their hierarchical constituent structure. LSTMs, instead, only do so after unambiguous training, and they do not systematically generalize to novel items. Overall, the results of our simulations indicate that a model can behave hierarchically without relying on hierarchical constituent structure

Hierarchy in language interpretation: Evidence from behavioural experiments and computational modelling

It has long been recognised that phrases and sentences are organised hierarchically, but many computational models of language treat them as sequences of words without computing constituent structure. Against this background, we conducted two experiments which showed that participants interpret ambiguous noun phrases, such as second blue ball, in terms of their abstract hierarchical structure rather than their linear surface order. When a neural network model was tested on this task, it could simulate such “hierarchical” behaviour. However, when we changed the training data such that they were not entirely unambiguous anymore, the model stopped generalising in a human-like way. It did not systematically generalise to novel items, and when it was trained on ambiguous trials, it strongly favoured the linear interpretation. We argue that these models should be endowed with a bias to make generalisations over hierarchical structure in order to be cognitively adequate models of human language

Genome-wide association study of regional brain volume suggests involvement of known psychiatry candidate genes, identified new candidates for psychiatric disorders and points to potential modes of their action

Though most psychiatric disorders are highly heritable, it has been hard to identify genetic risk factors involved, which are most likely of small individual effect size. A possible way to aid identification of risk genes is the use of intermediate phenotypes. These are supposed to be closer to the biological substrate(s) of the disorder than psychiatric diagnoses, and therefore less genetically complex. Intermediate phenotypes can be defined e. g. at the level of brain function and of regional brain structure. Both are highly heritable, and regional brain structure is linked to brain function. Within the Brain Imaging Genetics (BIG) study at the Radboud University Nijmegen (Medical Centre) we performed a genome-wide association study (GWAS) in 1000 of the currently 1400 healthy study participants. For all BIG participants, structural MRI brain images were available. Gray and white matter volumes were determined by brain segmentation using SPM software. FSL-FIRST was used to assess volumes of specific brain structures. Genotyping was performed on Affymetrix 6.0 arrays. Results implicate known candidates from earlier GWAS and candidate gene studies in mental disorders in the regulation of regional brain structure. E. g. polymorphisms in CDH13, featuring among the top-findings of GWAS in disorders including ADHD, addiction and schizophrenia, were found associated with amygdala volume. The ADHD candidate gene SNAP25 was found associated with total brain volume. In conclusion, the use of intermediate phenotypes based on (subcortical) brain volumes may shed more light on pathways from genes to diseases, but can also be expected to facilitate gene identification in psychiatric disorders

Imaging fetal anatomy.

Due to advancements in ultrasound techniques, the focus of antenatal ultrasound screening is moving towards the first trimester of pregnancy. The early first trimester however remains in part, a 'black box', due to the size of the developing embryo and the limitations of contemporary scanning techniques. Therefore there is a need for images of early anatomical developmental to improve our understanding of this area. By using new imaging techniques, we can not only obtain better images to further our knowledge of early embryonic development, but clear images of embryonic and fetal development can also be used in training for e.g. sonographers and fetal surgeons, or to educate parents expecting a child with a fetal anomaly. The aim of this review is to provide an overview of the past, present and future techniques used to capture images of the developing human embryo and fetus and provide the reader newest insights in upcoming and promising imaging techniques. The reader is taken from the earliest drawings of da Vinci, along the advancements in the fields of in utero ultrasound and MR imaging techniques towards high-resolution ex utero imaging using Micro-CT and ultra-high field MRI. Finally, a future perspective is given about the use of artificial intelligence in ultrasound and new potential imaging techniques such as synchrotron radiation-based CT to increase our knowledge regarding human development

The Composition of the Modernist Book: Ulysses, A Draft of XXX Cantos and The Making of Americans.

This is a study of the composition of three Modernist first editions: Ulysses (1922), The Making of Americans (1925) and A Draft of XXX Cantos (1930). The bibliographical and figurative commitments made to being in print by Ulysses, A Draft of XXX Cantos and The Making of Americans set a coherent program for reading Modernist texts in their perfected form: in print. The editorial reception of the Modernist book has proceeded, however, with reference to the editorial and bibliographical principles established by the New Bibliographers. In deferring to the authors and manuscripts of Modernist books as the highest source of textual authority, the vital significance of being in print to literary Modernism is obscured. The figure of the ideal Book concentrates the central aesthetic, intellectual and bibliographic problem posed the Modernist book: the making of literature. The rhyme with The Making of Americans is appropriate: this book intensifies and consolidates the propositions made about objective and autonomous composition made more hesitantly by Ulysses and A Draft of XXX Cantos. These three books display a gradual refusal to equate inscription and intention; their composition effaces all traces of a sovereign creative subjectivity. The vision of the book guides Modernist composition, and requires a critical distinction be drawn between manuscripts and printed letters. Modernism must be read in print. The vestigial nostalgia for Romantic modes of textual production and creation in Ulysses is repeated on the placards and proof-pages for the book. Printed drafts are revised and reformed by the pen of the author. The finality asserted by the printed letter is only reluctantly ceded on the publication of Ulysses. The composition of A Draft of XXX Cantos represents a further transition away from the script economy of Romanticism. The interplay between authorial typescripts, early publications and the first edition of A Draft of XXX Cantos assert an intermediate order of Modernist textuality which takes the printed page as its foundation. The Making of Americans relies on the absolute objectivity and anonymity of its composition for the effect of its narrative. Objectivity is the intellectual and aesthetic strategy which produces literature rather than the personality and memory of the author. The impersonality of the apparently automatically written manuscripts and scarcely revised typescripts for The Making of Americans severs the visible links between the writing author and her page. In their unwillingness to corroborate the modes of textual generation described by the New Bibliographers, these three books thematise their own composition as the exemplary Modernist and modern mode of textual generation. The Modernist book attenuates or denies a Romantic connection between the creative hand of the author and the surface image of the page: the mechanisms of print deliberately detach the author from the literary text. The distance of the author from the scene of textual reproduction is measured by the printed book. The composition of this analytical object is not a fallacy but an actuality, commemorated in the archive, enacted by the book. Modernism is the literature of the imprimatur rather than of authorial inscription and accordingly it is towards the first editions of Modernist texts that the attentions of editors and textual scholars must be directed

L2-Proficiency-Dependent Laterality Shift in Structural Connectivity of Brain Language Pathways

Diffusion tensor imaging (DTI) and a longitudinal language learning approach were applied to investigate the relationship between the achieved second language (L2) proficiency during L2 learning and the reorganization of structural connectivity between core language areas. Language proficiency tests and DTI scans were obtained from German students before and after they completed an intensive 6-week course of the Dutch language. In the initial learning stage, with increasing L2 proficiency, the hemispheric dominance of the Brodmann area (BA) 6-temporal pathway (mainly along the arcuate fasciculus) shifted from the left to the right hemisphere. With further increased proficiency, however, lateralization dominance was again found in the left BA6-temporal pathway. This result is consistent with reports in the literature that imply a stronger involvement of the right hemisphere in L2 processing especially for less proficient L2 speakers. This is the first time that an L2 proficiency-dependent laterality shift in the structural connectivity of language pathways during L2 acquisition has been observed to shift from left to right and back to left hemisphere dominance with increasing L2 proficiency. The authors additionally find that changes in fractional anisotropy values after the course are related to the time elapsed between the two scans. The results suggest that structural connectivity in (at least part of) the perisylvian language network may be subject to fast dynamic changes following language learning